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MEASURING  THE  PRODUCTIVITY  OF  MILITARY  PERSONNEL 


INTRODUCTION 

Since  the  advent  of  the  All-Volunteeer  Force  (AVF)  in  1973,  the 
research  community  within  the  military  has  devoted  much  effort  toward 
improving  personnel  management  in  the  areas  of  accession  and  retention. 
Although  not  all  factors  have  been  quantified,  we  are  able  to  estimate, 
with  some  accuracy,  what  draws  and  retains  personnel  of  differing 
characteristics  to  the  AVF.  With  knowledge  of  these  factors,  we  can 
provide  reasonable  predictions  of  enlistments  and  reenlistments. 

We  know,  for  example,  that  our  success  in  obtaining  new  recruits 
hinges  largely  on  four  factors:  the  ratio  of  military  to  civilian  pay, 
the  civilian  unemployment  rate,  the  number  of  recruiters,  and  the 
advertising  budget.  For  predicting  retention  during  the  first  term 
(hereafter  referred  to  as  survival  probability),  the  most  important 
factor  is  whether  the  enlistees  are  high  school  graduates  or  not.  For 
estimating  reenlistment  rates,  the  main  determinants  are  military  pay 
relative  to  civilian  pay,  and  the  civilian  unemployment  rate. 

We  could  refine  our  ability  to  forecast  the  supply  of  enlistees  by 
collecting  more  reliable  and  up-to-date  data  or  researching  a  broader 
range  of  variables  beyond  the  purely  economic  ones.  But  the  marginal 
benefits  from  such  an  effort  seem  small  compared  to  the  potential  payoff 
of  addressing  more  serious  gaps  in  military  manpower  research. 
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The  real  gap  Is  not  in  the  supply  side  of  the  market.  The  side  of 
the  market  that  we  do  not  understand  is  the  demand  side.  Who  should  the 
Navy,  or  the  overall  military,  seek  to  recruit  and  retain?  How  do 
military  personnel  substitute  for  each  other?  How  do  they  enhance  or 
reinforce  one  another?  In  short,  we  need  to  know  what  personnel  are 
most  individually  productive  and  how  different  force  configurations 
enhance  or  reduce  military  effectiveness. 

About  all  we  know  with  assurance  about  the  factors  that  determine 
effectiveness  are  of  those  that  Influence  first  term  attrition. 

Obviously  a  soldier  who  has  left  contributes  nothing  to  military 
effectiveness,  but  the  banality  of  this  observation  merely  highlights 
our  ignorance.  There  is  no  shortage  of  opinions  of  what  makes  military 
personnel  effective.  What  we  need,  however,  is  Statistical  data — data 
to  cpnfirm  or  refute  our  Intuition.  Too  often,  though,  we  are  stymied 
on  how  to  measure  military  output.1  In  the  few  cases  in  which  output 
can  be  measured,  the  data  often  exhibit  such  small  variation  in  input 
measures  that  it  is  hard  to  draw  precise  conclusions  on  the  effect  of 
different  input  mixes  on  output. 


The  exceptions  are  the  estimates  of  the  effects  of  maintenance 
activities  on  readiness,  described  by  Horowitz,  1977.  Unfortunately, 
only  a  small  portion  of  military  activities  lend  themselves  to  such 
easily  Identifiable  output  measures.  Similar  difficulties  exist  in  the 
areas  of  education  and  medical  care;  more  research,  however,  has  been 
done  in  these  areas. 
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In  this  paper,  we  analyze  an  unusual  and  largely  unresearched  data 
set,  Rand  Corporation's  Enlisted  Utilization  Survey  (EUS).  Using  data 
from  the  supervisors  of  Navy  first-term  enlisted  personnel,  we  estimate 
the  net  productivity  or  learning  curves  of  these  personnel.  Essentially 
we  try  to  explain  what  factors  make  Navy  recruits  learn  faster: 
ability,  schooling,  the  particular  job,  or  time  on  that  job.  This 
research  on  the  determinants  of  individual  productivity  is  but  a  first 
step  in  the  analysis  of  the  demand  for  military  manpower.  Still,  we 
think  our  results  are  sufficiently  provocative  to  warrant  further 
research. 

THE  MEASUREMENT  OF  MILITARY  OUTPUT 

It  Is  not  surprising  that  the  demand  side  of  the  market  for 
military  personnel  has  been  neglected.  First,  there  is  no  tangible 
output  to  measure.  Second,  since  the  military  uses  explicit  fixed- 
length  employment  contracts,  no  one  would  suggest  that  an  enlistee's 
current  productivity  is  identified  by  his  or  her  current  wage . ^ 


Finally,  the  military  gives  recruits  a  considerable  amount  of 
training — some  of  it  general  and  some  of  it  specific.  For  example. 


1  Basic  military  pay,  defined  on  pay  tables,  is  determined  by  military 
rank  and  years  of  service.  It  rises  very  little  over  the  first  four 
years.  In  1984,  for  example,  the  basic  pay  of  enlisted  personnel  In 
their  fourth  year  of  service  was  138  percent  of  the  basic  pay  of  new 
recruits.  In  addition  to  basic  pay,  there  are  other  pays  like  housing 
allowances  that  depend  on  the  individual's  marital  status. 
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nuclear-trained  electronics  technicians  (6-year  obligors)  receive  formal 
training  after  boot  camp  that  involves  433  days  of  instruction  and  costs 
$30,382;  this  job  requires  a  6-year  active  duty  commitment.1  Even  for 
4-year  commitments,  training  costs  are  substantial;  all  recruits  spend 
about  75  days  in  boot  camp.  The  occupationally  qualified  then  go  to  an 
"A-school"  for  formal  training  of  varying  length.  For  example,  non¬ 
nuclear  electronic  technicians  spend  240  days  at  A-school,  radiomen 
spend  126  days,  and  machinists  mates  spend  74  days. 

A  significant  application  of  this  work  is  on  the  length  of  the 
initial  employment  contract.  Currently,  Navy  contracts  vary  from  4  to 
6  years  with  the  training— intensive  nuclear  occupations  having  6  year,  a 
small  bunker  of  occupations  5  year,  and  the  majority  of  Navy  jobs  4  year 
initial  employment  contracts.  Fixed-length-explicit-employment 
contracts  are  found  very  rarely  in  the  civilian  econony  yet  they  are  the 
norm  in  the  military.  An  understanding  of  occupation-specific  learning 
curves  should  stimulate  research  into  occupationally  optimal  first  term 
enlistment  lengths  as  well  as  into  the  more  theoretical  question  of  why 
employment  contracts  differ  so  sharply  between  the  two  sectors. 

In  the  private  economy,  individuals  usually  pay  for  their  training. 
The  payment  may  be  direct  (college  tuition,  for  example)  or  indirect 
(lower  wages  when  an  employer  provides  the  training).  Indeed  on-the-job 

1  These  are  formal  instruction  costs  and  wages  while  in  training  (1979 
dollars).  See  Angier  and  Driscoll,  1982. 
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training  (OJT)  in  the  civilian  sector  is  often  identified  with  the  slope 
of  the  earning/experience  profile.  Occupations  with  large  components  of 
OJT  have  steeper  profiles  than  occupations  with  smaller  amounts  of 
"learning  of  the  job.” 

An  explicit  employment  contract  in  the  military  clearly  breaks  the 
linkage  between  spot  marginal  product  and  spot  productivity.  Lazear 
(1981)  and  others  argue  that  the  link  is  broken  even  in  the  civilian 
sector.  Implicit  contracts  between  private-sector  employees  and  their 
firms  are  sufficiently  pervasive  as  to  make  it  impossible  to  relate 
earnings  profiles  to  the  time  path  of  productivity.  In  fact,  attempts 
to  test  the  theory  that  wages  reflect  marginal  productivity  (see  Medoff 
and  Abraham  (1981))  find  that  there  are  substantial  discrepancies. 

In  a  world  of  fixed  length  employment  contracts,  either  explicit  or 
implicit,  hew  can  researchers  measure  the  productivity  of  employees?  We 
offer  one  approach  here.  The  population  we  analyze  is  a  cohort  of 
first-term  Navy  personnel.  At  this  juncture,  it  is  appropriate  to  turn 
to  a  discussion  of  our  data. 

THE  DATA 


In  1975  the  Rand  Corporation  conducted  a  survey  project  for  the 
Defense  Advanced  Research  Project  Agency,  intended  to  measure  the  growth 
of  productivity  over  the  first  enlistment  term.  (For  a  full  description 
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of  these  data,  as  well  as  an  analysis  of  the  appropriate  mix  of  first- 
term  and  second-term  personnel  for  the  Air  Force  see  Albrecht,  1979.) 
The  project  involved  two  surveys,  First,  a  set  of  military  occupations 
were  chosen  to  represent  the  spectrum  of  skills  required  by  the 
services.  Then,  19,000  first-term  enlistees  from  these  skill  areas  in 
the  Air  Force,  the  Army,  and  the  Navy  were  randomly  selected  from 
service  personnel  files.  These  individuals  were  sent  questionnaires 
that  requested  the  names  of  three  immediate  supervisors  as  well  as 
background  information  not  found  on  service  personnel  records.  (The 
questionnaires  are  available  from  the  authors  of  this  paper.)  The 
response  rate  was  72.9  percent,  resulting  in  a  total  of  6,558  question¬ 
naires  that  identified  individuals'  supervisors. 

Next,  net  productivity  estimates  were  collected  from  these 
supervisors.  The  questionnaire  used  for  this  survey  included  a  brief 
discussion  of  the  concept  of  net  productivity, ^  an  implicit  test  of 
whether  the  supervisor  understood  the  concept,  and  questions  about  the 
trainee's  net  productivity  at  different  points  in  time.  All  net 
productivity  assessments  were  relative:  the  net  productivity  of  the 
trainee  at  time  t  relative  to  the  net  productivity  of  the  average 
specialist  within  the  occupation  after  4  years  at  the  duty  station.  The 


1  Net  productivity  is  the  contribution  of  the  trainee  to  unit  output. 

It  is  negative  if  the  trainee  and  the  supervisor  together  produce  less 
than  the  supervisor  would  have  produced  responsibility  for  training  the 
individual. 
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supervisors  returned  7,110  questionnaires,  75.4  percent  of  those  mailed 
to  correct  addresses . ^ 

Before  discussing  our  empirical  results,  it  is  appropriate  to 
address  the  problems  caused  by  biases  in  the  supervisory  evaluations. 

The  Problems  of  Biases 


The  first  type  of  bias  arises  from  the  inherent  subjectivity  of 
supervisor's  evaluations.  They  reflect  individual  tastes,  performance 
standards,  and  perceptions  of  the  performance  of  others.  Nevertheless, 
if  the  assignment  of  individuals  to  supervisors  is  random  and  if  the 
sample  is  large,  there  will  be  no  systematic  evaluation  bias.  Given 
that  Navy  supervisors  have  little  or  no  influence  over  the  particular 
trainees  assigned  to  them,  it  seems  reasonable  to  characterize  the 
assignment  of  Navy  trainees  to  supervisors  as  random.  Since  we  also 
have  large  numbers  of  observations,  we  believe  this  form  of  bias  is 
unimportant. 


^  Because  .of  job  changes  and  misspelled  names,  13  percent  of  the 
supervisor  questionnaires  were  not  deliverable. 

2 

In  technical  terms,  this  type  of  supervisory  subjectivity  will  reduce 
the  accuracy  of  the  resultant  estimates.  Although  coefficient  estimates 
are  unbiased,  their  standard  deviations  will  be  larger  than  they  would 
be  in  a  world  of  homogeneous  supervisory  tastes. 
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A  second  type  of  bias  is  potentially  more  serious.  It  arises  from 
the  face  that  each  supervisor  denominates  his  evaluation  in  his  own 
particular  currency.  In  fact,  the  existence  of  this  bias  essentially 
halted  analysis  of  the  survey  data  at  the  Rand  Corporation.  Richard 
Cooper  and  Gary  Nelson,  1976,  perceive  two  sources  of  this  systematic 
bias.  First,  supervisors  may  differ  on  "location.”  Some  of  them  may 
rate  average  performance  as  a  "C"  while  others  perceive  "B”  work  as 
average.  Second,  supervisors  may  differ  in  perception  of  "scale."  Some 
perceive  large  differences  between  their  best  and  worst  performers, 
while  others  see  only  small  differences. 

Cooper  and  Nelson  showed  that  biases  created  by  systematic 
differences  in  scale  and  location  do  not  disappear,  even  with  large 
sample  sizes.  They  concluded  that  "although  the  location  bias  can  be 
handled  in  multiple  regression  models  through  familiar  dummy  variable 
techniques,  the  scale  bias  poses  special  estimation  problems."  They 
proposed  a  multi-scale  model  and  a  complex  strategy  that  involves 
choosing  among  complicated  estimation  strategies  on  the  basis  of  Monte 
Carlo  experiments.  Unfortunately,  the  data  do  not  contain  enough 
multiple  observations  (supervisor  "X"  rating  several  enlistees  and 
enlistee  ”Y”  being  rated  by  several  supervisors)  to  make  their 
techniques  practical. 
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An  Alternative  Approach 


A  simpler  and  more  appealing  approach  would  be  to  recognize  that 
supervisors  have  systematic  differences  in  the  scale  and  location  of 
their  evaluations.  Then,  if  we  can  measure  these  systematic  biases  of 
supervisors  and  then  control  for  them  in  the  productivity  regression 
equations.  With  such  controls,  we  could  estimate  the  true  effects  of 
time  on  the  job,  education,  and  ability,  on  productivity  growth  without 
bias.  A  close  look  at  the  rich  data  in  the  EUS  suggests  that  it  might 
be  possible  to  construct  variables  that  would  control  for  supervisory 
location  and  scale  bias. 

In  particular,  the  EUS  asked  each  supervisor  to  evaluate  the  typi¬ 
cal  A-school  trainee  in  each  rating  at  several  points:  after  one  month, 
after  2  years,  and  after  4  years  at  the  first  duty  station.^- 
Productivity  was  measured  relative  to  the  average  fourth-year  specialist 
in  the  Navy  rating.  Using  these  supervisor's  assessments,  we  computed 
supervisory  bias  control  variables  for  location  (DIFF)  and  scale  (VAR). 

Specifically  for  each  of  the  15  jobs,  consider  an  individual,  i, 
with  a  supervisor,  j.  Let  TYPj  be  supervisor  j 's  assessment  of  the 


^  Supervisors  were  asked  these  questions  twice:  once  for  the  typical 
A-school  trainee  in  their  rating,  and  once  for  the  typical  on-the-job 
trainee  in  their  rating.  To  compute  our  control  variables,  we  used  the 
appropriate  supervisory  assessment  (formal  schooling  (A-school)  or 
on-the-j  ob  (0 JT ) . 
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typical  trainee  at  time  t,  and  TYP  be  the  mean  assessment  of  supervisors 
in  that  rating  of  the  typical  trainee  at  time  t.  Then,  for  each 
individual 

DIFF^  »  TYPj(2  years)  -  TYP  (2  years) 

TYP.(1  month)  -  TYP . (4  years) 

VAR  »  - L - - 1 -  . 

1  TYP  (1  month)  -  TYP  (4  years) 

Location  bias  is  a  shift  effect  and  can  be  proxied  simply  by  the 
constructed  variable  DIFF.  (The  sign  on  DIFF  should  be  positive. 
Supervisors  who  believe  that  the  typical  trainee  is  more  productive  than 
their  peers  believe  him  to  be  will  also  tend  to  rate  particular 
individuals  as  more  productive.) 

Scale  bias,  on  the  other  hand,  refers  to  perceived  differences 

* 

(larger  or  smaller)  between  the  best  and  the  worst  performers. 
Individuals  who  have  a  large  value  of  VAR  have  been  evaluated  by 
supervisors  who  see  large  differences  in  the  growth  of  the  typical 
trainee  over  the  first  4  years  at  the  duty  station;  small  individual 
values  of  VAR  are  evaluations  by  supervisors  who  perceived  less  change 
in  the  productivity  of  the  typical  trainee  over  the  same  period.  To 
capture  this  scale  effect,  then,  it  is  necessary  to  enter  both  VAR  and 
VAR  interacted  with  time  at  the  duty  station  into  the  equation:  the 
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sign  on  VAR  should  be  negative,  and  the  sign  on  the  interaction  variable 


(VARTJ)  should  be  positive.^- 


EMPIRICAL  WORK 


The  Learning  Curve  Regressions 

We  begin  by  estimating  the  time  path  of  net  productivity  (or 
learning  curve)  for  first-term  trainees.  Each  observation  involves  an 
individual  and  his  or  her  supervisor  at  a  particular  time  at  the  first 
duty  station.  All  regression  results  are  estimated  by  ordinary  least 
squares . 

Initial  inspection  of  the  data  revealed  that  some  individuals  were 
not  first-termers  (some  were  Reservists  and  some  were  second-termers); 
these  observations  were  excluded.  Additionally,  we  selected  only  the 
observations  in  which  the  supervisor  said  he  was  familiar  with  the  work 
of  the  trainee. 

Regression  equations  were  developed  separately  for  each  of  the 
15  Navy  occupations  surveyed.  They  control  for  time  at  the  duty 


Supervisors  who  perceive  large  variances  in  productivity  essentially 
see  a  steeper  slope  in  the  productivity  profile.  In  short,  they 
perceive  individuals  beginning  as  quite  unproductive  (the  negative  sign 
on  VAR)  and  then  having  fast  productivity  growth  (the  positive  sign  on 
VARTJ). 
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station,  time  in  the  Navy  before  the  first  duty  station,  AFQT  score, 
high  school  education,  supervisor's  understanding  of  net  productivity, 
supervisory  bias,  and  missing  observations.^-  In  addition,  they  control 
for  individuals  who  initially  were  assigned  to  an  occupation  but  failed 
technical  training  school  and  were  assigned  to  general  detail  jobs  (AN, 
SN,  FN).  Variable  definitions  are  found  in  Table  1. 


The  full  individual  learning  curve  regression  results  are  displayed 
in  table  2.  The  corrections,  (DIFF,  VAR,  VARTJ)  developed  to  control 
for  systematic  differences  across  supervisors  in  the  location  and  scale 
cf  their  evaluations  perform  very  well.  All  have  the  correct  sign  and 
all  are  significant  at  the  99  percent  level.  The  variable  TEST  is 
positive  and  statistically  significant  in  14  of  15  regression 
equations.  It  has  the  value  one  if  the  individual  did  not  pass  the  net 
productivity  concept  quiz,  otherwise  it  is  zero.  Supervisors  who  did 
not  understand  the  concept  systematically  rated  the  productivity  of 

2 

their  trainees  higher  than  did  supervisors  who  understood  the  concept. 


*  Some  observations  had  missing  data — in  particular,  AFQT,  DIFF,  and 
VAR.  Rather  than  exclude  them  entirely,  we  assigned  the  mean  value  of 
the  variable.  We  then  flagged  these  observations  with  dummy  variables 
(AFQTFLAG,  DIFFFLAG,  and  VARFLAG).  With  this  procedure,  the 
coefficients  on  AFQT,  DIFF,  and  VAR  reflect  only  the  real  observation  of 
these  variables,  with  the  coefficients  on  AFQTFLAG,  DIFFFLAG,  AND 
VARFLAG  reflecting  the  missing  observations.  In  general,  the 
coefficients  on  these  "flag"  variables  cannot  be  Interpreted 
unambiguous ly . 

2 

Regressions  that  omit  observations  if  the  supervisor  did  not 
understand  the  concept  of  net  productivity  are  available  from  the 
authors  of  this  paper.  The  results  are  similar  to  the  regressions 
reported  here. 
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TABLE  1 

DEFINITIONS  OF  VARIABLES 

Dependent  Variable 

Net  Productivity:  Supervisor's  evaluation  of  individual's  net 

productivity  relative  to  that  of  a  specialist 
with  4  years  of  experience 

Independent  Variables 


TJ: 

months  at  the  first  duty  station 

TJSQ: 

(TJ)(TJ) 

AFQT: 

Armed  Forces  Qualifications  Test  score.  This 
intelligence  test  is  routinely  administered  to  all 
recruits 

HSG: 

One  if  high  school  diploma  graduate,  else  zero 

T: 

Months  in  Navy  before  arrival  at  first  duty  station 

DIFF: 

Difference  between  supervisor's  perception  of  the 
average  individual  and  the  average  supervisor's 
perception  of  average  (see  text) 

VAR: 

Measure  of  the  average  variability  perceived  by  this 
supervisor  and  the  overall  average  variability  (see 
text) 

VARTJ: 

(VAR)(TJ) 

TEST: 

Dummy  variable  with  the  value  of  one  for  supervisors 
who  did  not  understand  the  concept  of  net  productivity, 
else  zero 

FLUNK: 

A  dummy  variable  for  individuals  who  flunked  technical 
school  (only  relevant  for  general-duty  personnel  who 
are  not  occupationally  qualified) 

Control  Variables  for  Missing  Information 

These  variables  have  the  value  1  if  the  relevant  independent 
variable  are  missing.  Missing  variables  are  assigned  variable  means. 


AFQTFLAG: 

AFQT  scores  are  missing  for  about  one-third  of  the  non- 
occupational  qualified  personnel.  For  the  10 
occupations,  missing  values  vary  from  zero  to  15 
percent. 

DIFFFLAG: 

Missing  values  vary  from  8  to  29  percent  by  job. 

VARPLAG: 

Missing  values  vary  from  12  to  38  percent  by  job. 
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TABLE  2 


NET 

PRODUCTIVITY  REGRESSIONS 

Nuclear  submarine  occupations a 

Machinist 's 

Electrician  *s 

Electronics 

Mate  (MM  3355) 

Mate  (EM  3354) 

Technician  (ET  3353) 

TJ 

3.04 

3.30 

3.09 

(12.2) 

(11.8) 

(10.2) 

TJSQ 

-.05 

-.05 

-.06 

(16.9) 

(13.7) 

(14.4) 

AFQT 

.06 

.19 

.39 

(.9) 

(2.0) 

(4.7) 

T 

1.24 

.95 

1.06 

(11.6) 

(9.1) 

(7.7) 

TEST 

9.50 

4.40 

8.40 

(4.4) 

(1.9) 

(2.9) 

DIFFFLAG 

3.78 

16.98 

-9.40 

(1.1) 

(3.0) 

(1.9) 

VAR 

-53.67 

-48.08 

-57.58 

(9.5) 

(7.9) 

(8.6) 

VARFLAG 

-.87 

-13.62 

10.37 

(.3) 

(2.4) 

(2.2) 

VARTJ 

1.77 

1.29 

2.03 

(9.4) 

(6.2) 

(9.0) 

DIFF 

.39 

.35 

.25 

(12.9) 

(8.1) 

(5.7) 

Constant 

-.80 

.84 

-25.38 

R2 

.57 

.54 

.60 

#  Obs. 

2238 

1591 

1357 

a  Since  there  were  no  missing  observations  on  AFQT,  AFQTFLAG  is  not 
included  in  these  regressions.  Similarly,  HSG  does  not  appear  in  the 
nuclear  rating  regressions  since  all  individuals  were  high  school 
graduates. 
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TABLE  2  (Cont'd) 


Other  occupations 


Electronics 
Technician  (ET) 

Elect rician's 
Mate  (EM) 

Aviation 
Electrician's 
Mate  (AE) 

TJ 

3.50 

2.99 

3.62 

(15.9) 

(19.6) 

(4.7) 

TJSQ 

-.06 

-.05 

-.06 

(18.4) 

(21.5) 

(5.5) 

AFQT 

.08 

.002 

.50 

(1.2) 

(.1) 

(2.6) 

AFQTFLAG 

1.32 

21.32 

N.A. 

(.2) 

(4.3) 

HSDG 

11.54 

4.23 

-5.24 

(4.0) 

(2.5) 

(2.6) 

T 

.53 

.88 

.40 

(9.2) 

(5.2) 

(1.5) 

TEST 

7.00 

4.14 

-4.93 

(3.8) 

(3.3) 

(.7) 

DIFFFLAG 

-1.04 

.60 

35.15 

(.1) 

(.1) 

(4.3) 

VAR 

-37.08 

-41.33 

-81.78 

(9.5) 

(17.0) 

(4.9) 

VARFLAG 

-.15 

-1.48 

N.A. 

(.0) 

(.4) 

VARTJ 

1.48 

1.51 

1.49 

(10.4) 

(17.3) 

(2.7) 

DIFF 

.33 

.58 

.78 

(11.1) 

(26.0) 

(8.7) 

Constant 

2.72 

26.78 

27.03 

R2 

.47 

.53 

.64 

#Obs. 

2948 

4263 

200 
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TABLE  2  (Cont’d) 


Radioman  (RM) 


TJ 

3.67 

(20.4) 

TJSQ 

-.06 

(23.6) 

AFQT 

.16 

(3.8) 

AFQTFLAG 

1.34 

(.7) 

ESDG 

3.55 

(2.3) 

T 

.50 

(6.9) 

TEST 

5.36 

(3.7) 

DIFFFLAG 

-3.88 

(.7) 

VAR 

-38.12 

(13.1) 

VARFLAG 

7.55 

(1.4) 

VARTJ 

1.46 

(13.9) 

DIFF 

.54 

(21.7) 

Constant 

17.06 

R2 

.54 

#0bs .  ' 

3071 

Other  occupations 


Machinist 's 
Mate  (MM) 

Aviation 
Machinist  *s 
Mate  (AD) 

2.73 

3.02 

(14.4) 

(6.1) 

-.05 

-.06 

(15.8) 

(7.4) 

.18 

-.02 

(4.2) 

(.2) 

12.50 

10.88 

(1.5) 

(1.9) 

5.90 

.37 

(3.5) 

(.1) 

.73 

.11 

(10.8) 

(.7) 

9.68 

9.08 

(5.7) 

(2.4) 

2.64 

25.26 

(.6) 

(1.7) 

-34.71 

-48.40 

(10.4) 

(5.3) 

-3.58 

-4.77 

(.8) 

(.4) 

1.35 

1.62 

(11.4) 

(5.1) 

.42 

.46 

(16.2) 

(6.0) 

4.59 

51.78 

.46  ' 

.48 

3545 

453 
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TABLE  2  (Cont'd) 


Other  occupations 

Mess 

Management 

Dental 

Hospital 

Specialist  (MS) 

Technicians  (DT) 

Corps man  (HM) 

TJ 

2.05 

1.63 

2.29 

(8.5) 

(7.0) 

(8.0) 

TJSQ 

-.03 

-.03 

-.04 

(7.1) 

(6.9) 

(9.6) 

AFQT 

.25 

-.11 

-.02 

(3.6) 

(1.8) 

(.3) 

AFQTFLAG 

8.22 

8.11 

2.64 

(1.7) 

(2.7) 

(.8) 

HSDG 

4.92 

6.11 

3.92 

(2.3) 

(1.3) 

(1.2) 

T 

.87 

.43 

-.45 

(2.8) 

(4.6) 

(3.7) 

TEST 

9.85 

8.40 

14.37 

(4.8) 

(3.6) 

(3.0) 

DIFFFLAG 

-13.32 

-1.88 

-18.14 

(2.6) 

(.2) 

(3.0) 

VAR 

-31.36 

-29.93 

-29.50 

(10.0) 

(8.7) 

(6.2) 

VARFLAG 

10.36 

-9.11 

14.17 

(2.3) 

(1.1) 

(2.5) 

VARTJ 

.81 

.95 

1.23 

(7.3) 

(8.4) 

(7.3) 

DIFF 

.58 

.51 

.35 

(7.3) 

(12.4) 

(8.9) 

Constant 

18.43 

66.35 

58.77 

R2 

.34 

.38 

.33 

#Obs. 

2422 

1168 

1488 
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TABLE  2  (Cont'd) 


General 

-duty  personnel 

Seamen  (SN) 

Airmen  (AN) 

Firemen  (FN) 

TJ 

2.13 

2.53 

1.88 

(8.1) 

(7.3) 

(5.4) 

TJSQ 

-.04 

-.04 

-.03 

(8.7) 

(7.5) 

(5.9) 

AFQT 

.18 

.29 

.32 

(2.2) 

(2.5) 

(3.2) 

AFQTFLAG 

-.48 

-1.94 

-13.89 

(.2) 

(.5) 

(3.2) 

HSDG 

6.93 

9.38 

-1.74 

(3.2) 

(3.2) 

(.6)^ 

T 

.53 

.19 

.24 

(2.3) 

(.6) 

(.7) 

TEST 

8.57 

-2.94 

15.47 

(4.0) 

(1.0) 

(5.3) 

DIFFFLAG 

-12.36 

-16.41 

13.56 

(1.9) 

(1.1) 

(.9) 

VAR 

-39.98 

-36.35 

-36.41 

(8.8) 

(6.8) 

(6.1) 

VARFLAG 

13.47 

13.98 

.45 

(2.2) 

(1.0) 

(.0) 

VARTJ 

1.31 

1.29 

1.48 

(8.5) 

(6.8) 

(•7.1) 

DIFF 

.63 

.50 

.47 

(18.2) 

(10.5) 

(9.8) 

FLUNK 

-7.16 

-10.20 

-4.31 

(3.0) 

(2.7) 

(1.2) 

Constant 

27.13 

24.37 

16.69 

R2 

.40 

.47 

.45 

• 

CO 

o 

^*5 

2072 

839 

933 

Note:  Numbers  in  parentheses  beneath  coefficients  are  the  absolute 
values  of  the  t  statistics. 
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Net  productivity  is  -100  percent  if  the  individual  requires  full¬ 
time  supervision  by  a  4-year  specialist,  +100  percent  if  the  individual 
is  as  productive  as  a  specialist  with  4  years  of  job  experience.  This 
grows  over  time.  After  4  years  of  experience,  most  regressions  predict 
that  the  average  individuals  in  our  sample  achieve  the  100-percent  level 
of  a  typical  specialist.  (The  exceptions  are  in  the  general-duty  jobs, 
where  the  concept  of  a  4-year  specialist  is  obscure.) 

The  results  naturally  lead  to  two  areas  of  discussion:  the  time 
path  of  productivity,  and  the  effects  of  personal  characteristics  on  the 
level  of  productivity. 

The  Time  Path 


Even  a  cursory  inspection  of  these  results  suggests  that  Navy 
personnel  take  considerable  time  to  learn  their  jobs  and  become 
productive.  Moreover,  reasonably  sharp  differences  in  the  rate  of 
growth  of  learning  emerge.  While  the  average  seaman  (without 
specialized  training)  is  expected  to  arrive  at  his  first  duty  station 
after  about  2.5  months  in  the  Navy,  the  average  nuclear  electronics 
technician,  because  of  extensive  schooling,  is  not  programmed  to  arrive 
at  his  first  duty  station  until  almost  17  months  after  entering  the 
Navy.  (Because  of  waiting  time,  travel,  leave,  or  other  exigencies, 
programmed  arrival  probably  understates  the  time  it  takes  an  enlistee  to 
reach  his  first  duty  station.  Moreover,  at  the  time  of  the  EUS  survey 
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It  was  common  to  send  some  Individuals  to  sea  for  a  short  period  before 
they  began  classroom  instruction.  Thus,  in  our  data,  the  average  time 
until  arrival  at  the  first  duty  station  is  probably  longer  than  planned 
training  pipelines® ) 

Figure  1  illustrates  the  learning  curves  for  nuclear  electronics 
technicians  (ETs)  and  general-duty  seamen  (SNs).  The  curves  are  drawn 
for  high  school  graduates  having  mean  AFQT  scores  within  the  occupation 
(83.0  for  nuclear-trained  ETs  and  56.6  for  SNs).  Time  in  the  Navy  prior 
to  arrival  at  the  first  duty  station  (T)  is  assigned  the  current 
programmed  values.  Other  variables  in  the  regression  (except  for  those 
that  relate  to  TJ)  are  assigned  mean  values. 

While  an  SN  after  2  years  In  the  Navy  is  almost  70  percent  as 
effective  in  his  job  as  one  with  4  years  of  experience,  a  nuclear  ET 
with  2  years  In  the  Navy  has  only  reached  the  zero  net  productivity 
level.  In  short,  the  nuclear  ET  has  reached  the  point  at  which  his 
contributions  to  output  just  balance  the  output  lost  because  supervisors 
must  spend  time  supervising  him. 

Because  the  El's  training  takes  so  long,  during  his  his  entire 
6-year  enlistment  he  produces  less  than  a  third  of  the  output  that  would 
have  been  produced  by  a  specialist  with  4  years  of  work  experience. 
Moreover,  these  figures,  and  the  regressions  from  which  they  are 
derived,  abstract  from  both  formal  training  costs  and  attrition.  As 
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suggested  earlier,  for  a  nuclear  ET  graduate  in  1979  these  training 
costs  were  more  than  $30,000. 

While  figure  1  contrasts  the  two  ends  of  the  spectrum,  table  3 
illustrates  the  entire  spectrum  of  results — all  the  Navy  occupations  in 
the  EUS  survey.  (These . occupations  cover  about  half  of  Navy  enlisted 
personnel.)  For  technical  Navy  jobs,  individuals  contribute  nothing  to 
output  when  they  first  arrive  at  their  duty  stations.  Apparently, 
considerable  on- the— job  training  is  necessary  before  they  can  contribute 
to  output.  (For  occupationally-qualified  personnel,  exceptions  to  this 
pattern  are  less  skilled  personnel  (AD  and  MS)  and  medical  personnel  (DT 
and  HM).)  Why  medical  specialties  involve  less  on-the-job  training  is 
unclear.  Perhaps  a  smaller  proportion  of  them  are  assigned  to 
operational  units  and  therefore  do  not  receive  extensive  shipboard 
orientation.  Then  too,  these  jobs  may  require  mote  individual-specific 
skills  rather  than  a  range  of  skills.  Overall,  in  fact,  we  are  least 
successful  in  predicting  productivity  for  the  medical  specialties. 

Interestingly  enough,  net  productivity  levels  are  reasonably 
similar  across  the  ratings  after  individuals  have  been  at  their  duty 
station  for  2  years.  However,  these  similarities,  as  we  have  noted, 
mask  important  differences  across  the  occupations  in  how  long  indi¬ 
viduals  have  been  in  the  Navy:  in  the  EUS  data,  individuals  in  the 
three  nuclear  occupations  were  in  the  Navy  over  4  years,  individuals  in 
other  occupations  were  in  the  Navy  2-1/2  to  3-1/2  years,  and  general 
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FIG.  1:  THE  TIME  PATH  OF  PRODUCTIVITY  OVER  THE 
FIRST  ENLISTMENT  TERM 


-22- 


TABLE  3 


PRODUCTIVITY  TIME  PATHS® 


_ Submarine  nuclear  occupations _  _ Other  occupations _ 

Machinist's  Electrician's  Electronics  Electronics  Electrician's 

Mate  (MM  3355)  Mate  (EM  3354)  Technician  (ET  3353)  Technician  (ET)  Mate  (EM) 

Characteristics  of  Rating 

Current  planned  pipeline 


length 

11.4  DO. 

13.1  mo. 

16.9  mo. 

10.5  mo. 

6.7  i 

Average  months  In  EUS  data 
before  arrival  at  duty 
station 

27.1  mo. 

31.1  mo. 

32.6  mo. 

16.1  mo. 

6.8  i 

Net  productivity 

-  When  arrive 

at 

duty  station 

-11.5* 

0* 

-13.9* 

-6.4* 

-0.5* 

-  After  2  yrs 

at 

duty  station 

73. 1* 

60.4* 

76.3* 

76.0* 

77.0* 

-  After  4  yrs 

at 

duty  station 

96.0* 

101.7* 

101.1* 

99.7* 

95.1* 

TABLE  3  (Cont'd) 


Other  occupations 

(Cont  *d) 

Aviation 

Electricians 

Mate  (AE) 

Radiomen 

(RH) 

Machinists 
Mate  (MM) 

Aviation 

Machinists 

Mate  (AD) 

Mess  Management 
Specialist  (MS) 

Dental 

Technicians 

(DT) 

Characteristics  of  rating 

Current  planned  pipeline 
length 

7.0  mo. 

5.4  no. 

5.0  mo. 

4.3  mo. 

4.0  mo. 

5.2  mo. 

Average  months  in  EUS  data 
before  arrival  at  first 
duty  station 

16.1  mo. 

12.5  mo. 

11.9  mo. 

12.8  mo. 

6.1  mo. 

14.1  mo. 

Net  productivity 

-  When  arrived  at  duty 
station 

-19. IX 

.42 

-1.52 

13.52 

+13.32 

44.72 

-  After  2  yre  at  duty 
station 

69.72 

85.72 

69.32 

91.82 

65.22 

89.82 

-  After  4  yrs  at  duty 
station 

92.62 

95.42 

87.72 

106.22 

83.62 

102.62 

Hospital 
Corps  men 
(HH) 

5.0  mo 

17*9  mo 

27.82 

86.92 

97.52 


TABLE  3  (ContM) 


_ General  duties 

Seaman  (SN)  Airmen  (AN) 

Characteristics  of  Rating 

Current  planned  pipeline  length  2.5  mo*  2.5  mo. 

Average  months  in  EUS  data  before 

arrival  at  first  duty  station  5.2  mo.  5.5  mo. 


Firemen  (FN) 


2.5  mo. 


4.6  mo. 


Net  Productivity  Estimates 
-  When  arrive  at  first  duty 


station 

6.4% 

7. 31 

2.4% 

After  2  yre  at  duty 

station 

62. OX 

75.2% 

61.3% 

After  4  yrs  at  duty 

station 

83,4% 

95. 7X 

85.3% 

a  Regression 
evaluated  at 


coefficients  are  fro«  regressions  found  In  table  2.  The  coefficient  on  TJ  Is  the  eua  of  the  coefficient  on  TJ  and  VARTJ  (with 
ts  mean  value).  Net  productivity  evaluations  are  calculated  for  the  mean  characteristics  of  individuals  In  the  Navy  Job. 


duty  personnel  were  In  the  Navy  about  2-1/2  years  before  they  had 
2  years  at  a  duty  station* 

Effects  of  Individual  Characteristics  on  Productivity 

While  higher  AFQT  scores  and  high  school  graduation  appear  to  be 
positively  related  to  productivity,  the  magnitude  and  statistical 
significance  of  many  of  the  effects  are  not  as  large  as  we  had 
hypothesized.  This  should  not  be  surprising.  Since  the  allocation  of 
recruits  to  Navy  jobs  is  not  random  and  Is  based  on  many  of  the  same 
characteristics  that  influence  performance,  estimates  that  do  not 
account  for  this  may  be  downwardly  biased.  (We  expect,  for  example, 
that  the  OLS  estimates  of  the  effects  of  AFQT  and  education  will  be  too 
low).  Unbiased  estimates  can  be  obtained  by  controlling  for  the 
occupational  selection  process. 

Unfortunately,  standard  techniques  to  control  for  this  "selection 
bias’0  are  not  appropriate.  In  particular,  for  mid-skill-level  Navy  jobs 
the  ability  and  schooling  distributions  are  truncated  on  both  the  upper 
and  lower  tails.  Statistical  models  to  control  for  double  truncation 
bias  might  lead  to  larger  estimates.  Thus  the  generally  small  magnitude 
of  these  results  for  quality  should  be  interpreted  cautiously.^ 


See  Heckman,  19/9,  for  a  discussion  of  a  more  straightforward  problem 
of  selection  bias.  Double  truncation  bias  is  considerably  more 
difficult  to  implement  empirically. 
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We  do  know  that  high  school  graduates  and  individuals  with  higher 
AFQT  scores  are  considerably  more  likely  to  complete  the  first 
enlistment  term  than  are  not-high-school  graduates  and  individuals  with 
lew  scores.  In  short,  the  necessary  condition  for  the  production  of 
military  output — the  presence  of  the  individual — is  importantly  related 
to  measures  of  personnel  quality,  but  as  we  noted  before,  this  provides 
limited  insight  into  the  issue  of  actual  performance. 

Finally,  for  general-duty  personnel,  we  knew  whether  or  not  they 
attempted  to  become  rated  (occupation-qualified)  but  failed  technical 
school.  Conventional  Navy  wisdom  suggests  that  individuals  who  fail 
technical  school  will  be  unhappy  with  their  status  and,  thus,  less 
productive.  The  regression  results  support  this  position:  productivity 
levels  are  lower  for  people  who  failed  technical  training. 


IMPLICATIONS  AND  CONCLUSIONS 

Acquiring  skills  takes  considerable  time  in  many  Navy  jobs.  To 
some  extent,  current  Navy  contract  lengths  reflect  that  fact.  There  is 
no  evidence,  however,  that  the  length  of  these  contracts  has  been  set 
systematically  by  occupational  specialty  so  that  output  could  be 
achieved  at  least  cost.  Thus,  one  natural  outgrowth  of  this  research  on 
occupational  learning  curves  would  be  an  investigation  of  initial 
enlistment  contract  length. 
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It  nay  be  that  the  Navy  could  use  changes  In  contract  length  by 
occupational  specialty  to  generate  the  same  output  at  lower  cost. 
Determination  of  the  appropriate  contract  length  for  the  different 
occupations  requires  information  on  pay  and  training  costs  and 
productivity  profiles.  With  them,  the  period  of  time  necessary  for  the 
Navy  to  recoup  its  investment  (or  some  fraction  thereof)  can  be 
calculated. 

However,  supply  problems  must  also  be  considered.  With  longer 
contracts,  higher  pay  is  required  to  attract  the  same  number  of 
individuals.  Also,  longer  contracts  may  be  characterized  by  higher 
early  attrition.  Thus,  any  recruiting,  training,  and  career  force  cost 
savings  from  lengthening  initial  enlistment  contracts  mist  be  weighed 
against  costs  of  increased  pay  and  attrition.  Some  assumptions  will 
have  to  be  made  because  existing  data  do  not  allow  empirical  estimation 
of  all  the  important  variables.  However,  existing  information  should 
permit  a  worthwhile  examination  of  the  costs  and  benefits  of  varying 
first-term  enlistment  lengths. 

A  key  policy  variable  related  to  the  growth  of  productivity  during 
a  career  in  the  Navy  is  the  mix  between  careerists  and  first-termers. 

The  Navy  and  Air  Force  have  traditionally  had  larger  proportions  of 
experienced  personnel  than  have  the  Amy  and  the  Marine  Corps.  In  1980, 
over  42  percent  of  Navy  and  Air  Force  enlisted  personnel  were  in  the  top 
five  paygrades  (E-5  through  E-9),  compared  to  36  percent  of  the  Marine 
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Corps  and  Army.  Moreover,  the  differences  among  the  services  are  really 
concentrated  in  middle  grades  (E-5  through  E-7):  the  Navy  and  Air  Force 
have  6  percent  more  of  their  enlisted  force  in  these  pay grades  than  do 
the  Arny  and  the  Marine  Corps.  The  Navy,  moreover,  plans  to  expand  the 
proportion  of  experienced  personnel  (those  with  more  than  4  years 
experience). 

To  address  issues  of  who  the  military  should  recruit,  who  the 
military  should  retain,  and  how  the  military  should  distribute  these 

personnel,  much  more  work  on  ‘the  demand  side  is  necessary.  If  we  are  to 

address  the  demand  side  of  personnel  questions  with  the  degree  of 
sophistication  with  which  we  address  supply  questions,  we  need  to  think 
hard  about  what  data  we  need  and  whether  experimental  data  are  required. 

This  is  an  area  of  research  that  is  of  interest  to  labor  economists 

within  and  without  the  military  research  community.  Ths  relationship  of 
experience  and  personnel  characteristics  to  marginal  productivity,  and 
of  productivity  to  wages  and  wage  contracts  is  not  well  understood. 

This  work  represents  an  initial  step  to  explore  this  issue,  but  a 
substantial  research  agenda  remains. 


* 
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